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© Aircraft helmet pointing angle display symbology. 



f^® A helmet mounted display system provide tm- 
^ages to a pilot in an aircraft cockpit by sensing the 
-^attitude of the pilot's helmet with respect to the 
5» aircraft or cockpit and retrieving stored signals indi- 
^■cative of points within the cockpit which are within 
Qthe field of view of the pilot for display of symbolic 
images of the cockpit points such that the symbolic 
CO images coincide, from the pilot's point of view, with 
Qthe cockpit points. 

Q. 
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Aircraft Helmet Pointing Angle Display Symbology 



The invention described herein may employ 
some of the teachings disclosed and claimed in 
commonly owned copending applications filed on 
even date herewith by Harper et al, (Attorney Dock- 
et No. S-3924). entitled AIRCRAFT WAYPOINT 
DISPLAY SYMBOLOGY; by Kass et al (Attorney 
Docket No.: S-4067) entitled AIRCRAFT ALTITUDE 
DISPLAY SYMBOLOGY; by Stiles et al, (Attorney 
Docket No. S-4068). entitled AIRCRAFT TORQUE 
DISPLAY SYMBOLOGY; by Hamilton et al. 
(Attorney Docket No. S-4069) entitled AIRCRAFT 
VELOCITY/ACCELERATION DISPLAY SYMBOL- 
OGY; by Spero et al, and (Attorney Docket No. S- 
4170), entitled CONTACT- ANALOG HEADUP DIS- 
PLAY METHOD AND APPARATUS. 

The invention relates to the presentation of 
Various aircraft operating parameters and mission 
information to the pilot, via a display system. 

Modem high-performance aircraft require the 
monitoring of a tremendous amount of sensor data 
indicative of both airframe and engine operating 
parameters simply to remain aloft Much of the 
sensor data is combined and analyzed by various 
automated flight systems, such as a Right Man- 
agement System, a Flight Director, an Autopilot a 
Stability Augmentation System, and/or an Electron- 
ic Engine Control System to control certain operat- 
ing parameters at preset limits, to pilot-selected 
values, or within safety thresholds. The ultimate 
effect of these systems is typically "transparent" to 
the pilot and pilot workload is reduced. Neverthe- 
less, it is still vital that many parameters are pre- 
sented via a display to the pilot so that he is 
cognizant not oniy of present operating conditions, 
but also of available "reserves" within the flight 
envelope of the aircraft 

In the context of a military aircraft, a plethora of 
weapons status and flight mission data must also 
be presented to the pilot. 

One can readily appreciate the need to present 
data to the pilot in as succinct unobtrusive, and 
meaningful manner as possible, especially in the 
context of a single pilot aircraft 

To this end. it has been known to combine 
data and present oniy the combined result to the 
pilot in the form of "symbology", or a pictorial 
representation, rather than in digital or analog scale 
form. The latter is exemplified in U. S. Patent No. 
4,368.517 (Lovering, 1983). 

Besides console mounted displays, heads-up 
and helmet-mounted displays are becoming more 
used for displaying data and symbology. Both 
heads-up and helmet-mounted displays present in- 
formation, typically via colllmated light rays to the 
pilot's eye or eyes via a semi-transparent display 



so that he can perceive both the imaged informa- 
tion and the view out of the cockpit simultaneously 
without having to lower his head or accommodate 
his eyes. U.S. Patent 4.305.057 (Rolston. 1981) 
s illustrates the heads-up type and U. S. Patent Nos. 
3,923,370 (Mostrom, 1975), 4, 269,476 (Gauthier, et 
al, 1981), and 4,446.480 & 4.439.157 (Breglia, et al, 
1984) are exemplary of helmet mounted display 
systems. 

10 Despite the advances that have been made in 

the area of helmet-mounted display symbology 
(see for instance. U. S. Army publication TM 55- 
1520-238-10. relating to the Apache Helicopter, at 
pages 4-19 through 4-23) there still exists a need 

15 for improvement and room for innovation. 

It is an object of this invention to provide an 
Improved symbology for use in a display system. 

According to a first aspect of the invention, an 
image of an altitude symbol (30) is provided to a 

20 pilot by means of a display device (22) in response 
to a sensed altitude signal. The altitude symbol 
comprises a larger isosceles triangle (34) and a 
smaller isosceles triangle (36) sharing its base with 
the larger isosceles triangle. The position of the 

25 triangles within a rectangular area (32) on the dis- 
play device corresponds to the aircraft altitude. 
Portions of the triangles which may. according to 
the altitude, fall outside of the rectangular area are 
occluded. 

30 A line and a digital display of altitude may 

appear across the rectangular area Portions of the 
triangle in the regions of the line and digital display 
are occluded. 

This display will allow the pilot to acquire al- 

35 titude information more quickly and with less cog- 
nitive processing than is currently required. This 
display concept will allow the pilot to readily per- 
ceive a gross approximation of the aircraft attitude 
by merely giancing at this display and seeing how 

40 "high" the aircraft is compared to known height 
yardsticks (e.g., triangles) which might instead be 
superimposed over the reai-world view. The display 
provides a better means of information transfer 
using only peripheral cueing. The precise altitude 

45 is also provided via the digital display. 

The triangle symbois could be designed to 
display alternate altitudes, such a 0, 25. 50 and 100 
units, depending on mission suitability. 

According to a second aspect of the invention. 

so an image of a power symbol (50) is provided to a 
pilot by means of a display device (22) in response 
to at least two sensed torque signals. The power 
symbol comprises a vertical line (56) which serves 
as a scale, and arrowheads (58. 60) disposed on 
either side of the scale at a position indicative of 
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the engine torque of two engines. The arrowheads 
may only be displayed when there is a threshold 
torque split between the two engines, or when the 
torque on any single engine goes out of range. A 
digital display of average torque may be Included 
In a box at the bottom of the scale. 

For helicopters, a solid triangle symbol (62) 
may be displayed along the scale to Indicate power 
required to hover out of ground effect 

A horizontal line symbol (64) may be displayed 
along the scale to indicate the maximum power 
available from the engines altogether. 

For helicopters, a thicker vertical line symbol 
(66) may be superimposed upon the scale to in- 
dicate the instantaneous estimated power setting 
as a function of the pilot's collective stick input For 
fixed wing aircraft, this, might indicate a cockpit 
torque command. 

According to a third aspect of the invention, 
images of navigational symbols are provided to a 
pilot by means of a display device (22) in response 
to sensed navigational signals. A horizon line sym- 
bol (72) is provided in such a way that it coincides, 
from the perspective of the aircraft or pilot, with the 
horizon. A rectangular box symbol (70) is provided 
above the horizon line at a position indicative of the 
location of the current mission waypoint, and a 
digital display (76) of the current waypoint number 
or the distance thereto may be presented in the 
box. A line (74) extends from the box down across 
the horizon line to a point (78) below the horizon 
line and is suggestive of the distance of the aircraft 
from the current waypoint The line (74) may be 
imaged such that its position on the horizon cor- 
responds to the bearing to .the current waypoint 
from the perspective of the aircraft or pilot The 
point (78) may terminate such that its image co- 
incides, from the perspective of the aircraft or pilot, 
with the actual location of the waypoint on the 
earth. Another symbol (80). indicative of the posi- 
tion of a subsequent mission waypoint may also be 
presented. 

A symbol (84) may be provided at a position 
relative to the current waypoint symbol (70) indica- 
tive of the direction which the pilot may steer to 
return via a smooth path to the mission leg which 
will take him to the current waypoint 

This display will allow the pilot to acquire flight 
plan (navigational) information as well as 
heading/steering command cues more quickly and 
with less cognitive processing than is currently 
required. This display concept will allow the pilot to 
readily perceive the location of the waypoints due 
to their superimposrtion over the real-world view 
providing a better means of information transfer. 

In accordance with a fourth aspect of the inven- 
tion, an image of an azimuth tape symbol (80) may 
be provided indicative of the real world azimuth of 



the pilot's view out of the cockpit 

An image of another symbol (112) may be 
presented, in accord with a fifth aspect of the 
Invention, in response to sensed signals indicative 

6 of the position of the pilot's head with respect to 
the cockpit, the symbol (112) being indicative of 
cockpit structures so that the pilot is cognizant of 
his orientation within the cockpit under night flying 
conditions in which Imagery from image sensors is 

10 also provided to the pilot 

According to a sixth aspect of the present 
invention, in response to sensed signals Indicative 
of aircraft heading, velocity and acceleration, a 
symbol (120) may be presented to provide horizon- 

fs tal velocity information to the pilot A velocity vec- 
tor symbol takes the form of a line emanating from 
a circular symbol and has a length magnitude 
proportional to the magnitude of the sensed ve- 
locity. The direction of the vector relative to the 

20 vertical axis of the display indicates the direction of 
the vehicle velocity relative to its longitudinal axis. 
The acceleration of the aircraft is indicated grossly 
by the rate of change of the velocity vector itself. 
However, it is also indicated by the form of an 

25 arrowhead at the other end of the velocity vector. 
As the rate of change of velocity increases the 
arrowhead points away from the central circular 
symbol. Diminishing velocity is indicated by the 
opposite direction of the arrowhead. A constant 

30 velocity is indicated .by a flat acceleration cue 
(making the velocity vector arrowhead appear as a 
"T"). A box can be provided around the central 
circular symbol in order to quantitatively indicate a 
selected number of knots from which the mag- 

35 nitude of velocity can be estimated. A decision 
may be made to only indicate the box when the 
velocity is less than a selected number of knots, 
e.g.. 10 knots so that it does not become a distrac- 
tion while traveling at greater rates of speed where 

40 an exact magnitude is of no concern. 

These and other objects, features and advan- 
tages of the present invention will become more 
apparent In light of the following detailed descrip- 
tion of an embodiment thereof, as. illustrated in the 

45 accompanying drawing. 



Brief Description of the Drawing 

so Fig 1 is a block diagram of an aircraft dis- 

play system; 

Fig. 2 is a pictorial representation of altitude 
display symbology, according to the first aspect of 
this invention; 

55 Fig. 3 is a pictorial representation of power 

display symbology. according to the second aspect 
of this invention; 
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Fig. 4 is a pictorial representation of 
way point and steering cue display symbology, ac- 
cording to the third aspect of this invention; 

Fig. 5 is a pictorial representation of heading 
display symbology, according to the fourth aspect 
of this invention; 

Fig. 6 is a pictorial representation of cockpit 
structure display symbology, according to the fifth 
aspect of this invention; 

Fig. 7 is "a pictorial representation of the 
displays of Figs. 2-5 as they might (aggregately) 
appear to a pilot using a display system of the 
helmet mounted type; 

Fig. 8 is an illustration of angular relations 
between a flight plan leg and an aircraft off-course; 

Fig. 9 is an illustration of several paths flown 
by an off-course aircraft from various positions 
back on-course, according to the present invention; 

Fig. 10 is an Illustration of a prior art 
velocity/acceleration symbol; 

Figs.11A-11C illustrates a 

velocity/acceleration symbol, according to the 
present invention; and 

Fig. 12 illustrates a velocity/acceleration 
symbol, according to the present invention for 
three cases of acceleration. 

Fig. 1 shows an aircraft computer 10 receiving 
signals from various airframe sensors 12 (such as 
position, heading, attitude, and altitude), engine 
sensors 14 (such as torque), control sensors 16 
(such as cyclic/collective pitch and yaw), helmet 
attitude and position sensors 18, and input devices 
20 (such as devices for entering flight plan informa- 
tion). In a manner that is generally within the scope 
of one of ordinary skill in the art, the computer 10 
generates output signals that appear as digital data, 
analog data, and/or symbology for providing im- 
ages thereof to the pilot on a display system (22) 
such as, without limitation, a heads-up display or a 
helmet mounted display. Figs. 2-7 are illustrative of 
various symbolic images as they may appear to a 
pilot on a display, according to the present inven- 
tion. 



ALTITUDE SYMBOLS 



Fig. 2 shows four examples of an altitude sym- 
bol for display as symbolic altitude images in re- 
sponse to sensing four discrete altitudes by means 
of, e.g., a radar altimeter (sensor 12 of Fig. 1). the 
four examples are labeled 30A. 30B. 30C and 30D 
and are herein generally referred to by the numeral 
30. 

The altitude display 30 is presented within a 
discrete rectangular area 32 (shown in phantom) of 



height h and width w on the viewing screen of a 
display system such as a heads-up or a helmet- 
mounted display system type. With reference to 
the example 30C, two isosceles triangles, a larger 

s triangle 34 and a smaller triangle 36 are presented 
within the area 32. The larger triangle 34 has a 
height h and a base width w, and shares its base 
(which may or may not actually be visible on the 
display) with the smaller triangle 36 which has a 

10 height/2 and a base width of w. A fixed location line 
38 appears horizontally (in all instances) across the 
area 32 at h/2, or at the apex of the smaller triangle 
36 as shown in the example 30C. A digital display 
40 of altitude appears just above the line 38. 

75 The two triangles 34 and 36 move, in unison, 

up and down within the area 32 in response to 
altitude changes and, as may be readily noted in 
the examples 30a. 30B and 30D, the portionof the 
triangles 34,36 outside of the viewing area 32 are 

20 occluded (made not visible to the pilot). Thus.we 
see In the examples 30A, 30B, 30C and 30D the 
altitude symbology as it would appear to the pilot 
at four discrete altitudes, zero, fifty, one hundred 
and two hundred units, respectively. It will also be 

25 noted that the triangle symbols 34, 36 are occluded 
In the region of the digital display 40. 

The triangles 34, 36 will move vertically down- 
ward as the aircraft altitude increases, and upwards 
as the aircraft attitude decreases. The fixed location 

30 digital display 40. which serves as the zero refer- 
ence, will remain at a fixed height on the screen. 
Therefore, the pictorial display will appear to slide 
behind the digital display. 

35 

POWER SYMBOL 



Fig. 3 shows the display associated with en- 
40 gine torque and, for helicopters, power available to 
hover. Engine torque for one or more engines may 
be a directly measured parameter (sensor 14 of 
Fig. 1). and power available to hover is typically a 
calculated value based on several engine operating 
45 parameters. See for example, U.S. Patent 
4,467.640 (to Morrison. 1984) and copending ap- 
plication U.S. Serial No. 06/827.221. filed by Lap- 
pos et aJ. 

The display format utilizes a pictorial display 
so 50 showing various aircraft parameters. The display 
50 is essentially a "thermometer. " The data sup- 
porting these displays are derived from signals 
provided by aircraft sensors, which signals are fil- 
tered and processed to produce integrated power 
55 indications: engine torque (both digital and analog), 
power required to hover out of ground effect, and 
power available (power margin). 

The thermometer has a rectangular base por- 
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tlon 52 containing a digital display 54 of the aver- 
age torque produced by the engines as a percent- 
age of rated torque. A vertical line symbol 56 rises 
up from the base portion 52 and is "fixed" In that it 
serves as a scale for other "moving" symbols. The 
top of the scale corresponds to 120% (maximum) 
of rated (100%) torque. The bottom of the scale 
corresponds to minimum (0%) engine torque. 

Two opposing "arrowheads" 58 and 60 may be 
disposed one on either side of the scale 56 to 
represent the instantaneous torque of each engine 
(one arrowhead per engine) in an analog manner 
by their position along the scale. This gives a 
ready indication of torque "split" to the pilot, but to 
avoid displaying unnecessary information, the 
arrowheads need only be displayed whenever the 
difference in torque between the two engines ex- 
ceeds a selected level, such as 15% or when the 
torque on any single engine goes out of a chosen 
range. 

For helicopters, a right triangle symbol 62 is 
positioned on the scale, as shown, to represent the 
minimum power required to hover out of ground 
effect This is a computed parameter, and the 
visual indication thereof is quite important to the 
pilot vis-a-vis the estimated power available symbol 
described below. As will be readily appreciated by 
one of ordinary skill in the art, if the power required 
exceeds the estimated power available, in other 
words if the triangle symbol rises above the es- 
timated power available symbol described below, 
severe degradation of aircraft performance may 
occur. 

The estimated power available symbol 64 is a 
horizontal line which presents an estimate of the 
maximum power available from both engines taken 
together, given current atmospheric conditions. 
This horizontal line intersects the torque scale 56, 
typically near the top thereof. 

A solid line 66, thicker than the line 56, (i.e., 
the "fluid" of the "thermometer") rises upward 
along the line 56 from the base portion 52. This 
symbol 66 is an analog representation of the in- 
stantaneous estimated power setting, which is a 
computed parameter, and represents the power 
setting commanded by the pilot's collective input 

The torque scale 56 and the frame 52 around 
the digital display 54 are the only elements of the 
power display 50 that remain static. All of the other 
display elements move dynamically with a range of 
0% and 120% of torque. 

This display will offer the pilot a better, more 
extensive combination of pre-processed information 
than is currently available. For example, as long as 
the display shows that the power required to hover 
out of ground effect triangle is below the estimated 
power available line, the pilot will known that the 
aircraft is fully capable of performing any desired 



maneuver due to the fact that the hover out of 
ground effect maneuver is the most power Inten- 
sive flight maneuver. In addition, the instantaneous 
estimated power setting display element will effec- 
s tively anticipate the mechanical delay between a 
collective input and the actual torque change in the 
engines, thereby counter-balancing the loss of the 
proprioceptive feedback incurred due to the utiliza- 
tion of a modem side-arm controller. 

io 

WAYPOINT SYMBOLOGY 



is Fig. 4 shows symbols indicative of "waypoints" 

superimposed on a horizon line. The waypoints* 
represent one or more ground position points in a 
series of such points which make up benchmarks 
in a preselected flight plan. The earth coordinates 

20 of the flight plan waypoints would typically be 
entered prior to takeoff into the computer 10 of Fig. 
1 via one or more of the input devices 20. 

The display format may utilize a pictorial repre- 
sentation of two such navigational cues on a hori- 

25 zon line, showing both the upcoming and subse- 
quent waypoints with respect to each other and the 
horizon. The horizon line may be displayed such 
that it remains parallel to the horizon and in-line 
with the horizon, from the perspective of the aircraft 

30 or the pilot 

The large rectangular flag 70 represents the 
upcoming (current) waypoint along the pro- 
grammed flight plan. The vertical height of the flag 
70 relative to the displayed horizon iine 72 does 

os not change, but the stem 74 "grows" as the 
waypoint gets closer and appears, from the per- 
spective of the aircraft or the pilot, as if it were 
actually attached to the point it represents on the 
earth. The bottom of the stem 74 will has a small 

40 solid symbol 78 attached to it which remains 
"planted" on the same earth point The flag has a 
digital display 76 which may be the waypoint's 
identifier or an indication of the distance to that 
point The stem of the flag will always remain 

45 perpendicular to the horizon line. Changes in at- 
titude of the referent aircraft or helmet will result in 
the horizon along with the flagpoles "tilting," i.e., 
the horizon symbol always stays with the actual 
horizon and the flagpoles always remain upright 

so with respect to the horizon. 

The smaller square flag 80 depicts the location 
of the subsequent (next) waypoint in the flight plan. 
Unlike the larger flag, the stem of the small flag 
does not grow beneath the horizon line 72. The 

55 stem 82 of the flags 72 always remains perpen- 
dicular to the horizon line. There may be, but there 
is preferably no digital display in the smaller flag 
80. 
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As suggested above, the horizon and both of 
the waypoint symbols 70. 80 will move In various 
directions on the image source or display 22 sur- 
face (e.g., a CRT) proportional to the relative at- 
titude of the aircraft alone (for heads-up displays), 5 
or the aircraft and pilot's helmet taken together (for 
helmet-mounted displays). The flags will therefore 
appear to the pilot to have been "planted" at a 
specific geographical location In the real-world. 

~ln order" to~prdperiy~ position the "horizon and to 
waypoint symbology with respect to the pilot's hel- 
met, for a helmet-mounted display, it is necessary 
to conceive of the earth, the aircraft and the pilot's 
helmet as being associated with separate coordi- 
nate systems having separate origins freely trans- is 
lating and rotating with respect to one another. On 
the other hand, if it is only desired to position the 
horizon and waypoint symbology with respect to 
the aircraft it is only necessary to conceive of the 
earth and aircraft as being associated with separate 20 
coordinate systems. The pilot is considered part of 
the aircraft for that case (the simple heads-up dis- 
play case), i.e., his helmet position and attitude are 
ignored and assumed to be in a fixed position and 
orientation. See U.S. Patent 4,305,057 to Rolston. 25 

Such equations can be used for the simple 
heads-up display case where the aircraft is the 
referent for imaging purposes. For the head-moun- 
ted display case, where the pilot's head is the 
referent it is necessary to perform an additional set 30 
of translations and rotations. See copending ap- 
plication. U.S. Serial Number (Attorney Docket No. 
S-4170) for an example of a series of coordinate 
transformations (from earth to aircraft to helmet to 
display coordinates). 35 

The manner in which the waypoints are re- 
trieved may be thought of as progressing from 
retrieving a first waypoint position signal and iden- 
tifying that signal as the current waypoint position 
signal until it is passed. At the same time as the 40 
first waypoint position signal is retrieved, a second 
waypoint position signal (next in sequence) is re- 
trieved and identified as the subsequent waypoint 
position signal indicative of the position of the next 
waypoint in the selected flight plan after the up- 45 
coming or current waypoint. 

After determining that the aircraft is within a 
first selected distance of the current waypoint a 
determination is made as to whether the aircraft or 
helmet has an increasing distance between itself 50 
and the upcoming waypoint; if so, a further deter- 
mination is then made as to whether or not the 
distance between the aircraft or helmet and the 
subsequent waypoint position is decreasing. If so. 
the subsequent waypoint is from that point on 55 
identified as the current waypoint and a third 
waypoint position signal is retrieved from storage 
and identified as the new subsequent waypoint 



position signal. If the aircraft comes within a sec- 
ond selected distance of the current waypoint (less 
than the first selected distance) before it is deter- 
mined that both the distance to the current 
waypoint Is increasing and the distance to the next 
waypoint is decreasing, the identity of the current 
waypoint is at that point automatically changed to 
that of the next waypoint The same process is 
continued until the destination is reached. Such a 
procedure Is described In more detail in copending 
application U.S. Serial No. (Attorney Docket No. S- 
4170).Copy is enclosed) 



STEERING CUE SYMBOL 



Fig. 4 also shows a steering cue display 84 
which operates in conjunction with the waypoint 
display. 

The purpose of the waypoint flags 70, 80 is to 
indicate to a pilot the real world location of the 
current waypoint (the one being flown to) and the 
next waypoint. These flags occupy their real world 
positions with respect to the horizon line both in 
azimuth and distance from the aircraft The dis- 
tance from the aircraft is indicated by the waypoint 
flag pole growing larger as the aircraft approaches 
the waypoint. 

The purpose of the steering cue 84 is to aid 
the pilot in reaching the current waypoint If the 
aircraft's position is off the flight leg (the straight 
line connecting the last and current waypoints), the 
steering cue directs the pilot to return to the flight 
leg in a gradual and smooth manner (not to fly 
directly at the waypoint). An algorithm and cor- 
responding illustrative example are disclosed so as 
to enable one of ordinary skill in the art to imple- 
ment the steering cue display via appropriate soft- 
ware in the computer 10 of Fig. 1. 

Thus, the image of the steering cue may be 
provided to the pilot in order to indicate an aircraft 
heading consistent with following the preselected 
flight plan to the current waypoint or, in some 
cases, the next waypoint The steering cue may be 
presented in close proximity to and with respect to 
the horizon as shown by symbol 84 in Fig. 4 or a 
helmet compass bearing symbol as shown by a 
symbol 84b in Fig.5. (As shown in Figs. 4 & 5. the 
steering cue may take the form of a carat-shaped 
symbol which moves horizontally just below a com- 
pass heading symbol which the pilot may follow.) 
In either event the carat symbol may. for exam- 
ple,also have 3 possible orientations: if the 
direction-to-steer is within plus or minus a selected 
number of degrees (e.g., 19 degrees) of the vertical 
centeriino of the pilot's field of view, then the carat 
points upward, as shown in Figs. 4 &5; if the 
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direction-to-steer is beyond plus or minus the se- 
lected range then the carat will rotate to either 
point left or right to cue the pilot which way to turn 
to bring the carat within the selected range. 

The steering cue may be provided so as to 6 
guide the pilot back on the current flight leg as 
disclosed above or, upon closely approaching a 
current waypoint where the next flight leg will short- 
ly be in a different direction,to guide the pilot so as 
to enable him to turn the "comer" in a smooth to 
manner. An aircraft symbol 84a may be provided 
as shown In Rg. 4 in conjunction with the steering 
cue symbol 84 to indicate the current heading of 
the aircraft with respect to the horizon or, as shown 
by a symbol 84c in Rg. 5 f the helmet compass 15 
bearing symbol. 

The algorithm first determines, as described 
above in connection with the separate description 
of the waypoint symbology, when the aircraft has 
"passed" the current waypoint and the waypolnts 20 
(past, current and next) are updated. 

Referring first to Rg. 8. a point 85a corre- 
sponds to the position on the ground of a current 
waypoint and a point 85b represents the last 
waypoint A point 86 corresponds to the present 25 
position of the aircraft. An angle A measures the 
angle between a flight plan path 87 and a line 88 
from the current aircraft position to the current 
waypoint. An angle B is indicative of the angle 
between the path 87 and a line 89 projected from 30 
point 86 in the direction to be indicated by the 
steering cue, intersecting line 87 at a point 90. 

The algorithm is to set angle B equal to the 
arctan of a constant times tanA. The constant will 
most advantageously be set to a value between 1 .5 35 
and 3. 

For cases where the aircraft is closely ap- 
proaching the current waypoint, it will be desirable 
to change the identity of the current waypoint for 
purposes of the steering cue only, so that an 40 
efficient "comer" may be turned. In other words, 
the current waypoint continues to be imaged until 
its identity is changed in the normal way, described 
previously. Some typical cornering paths to the 
next waypoint for a plan having a right angle turn . 45 
using this algorithm are shown in Rg. 9. A circle 91 
indicates a selected distance for changing the iden- 
tity, for steering cue purposes only, of a current 
waypoint 92 to that of the last waypoint and that of 
a next waypoint 93 to that of the current waypoint. so 
Rg. 9 also illustrates a waypoint 93 which pre- 
ceded waypoint 92 in the flight plan. Starting with 
an aircraft position 94 on a preplanned flight path 
94a between points 93 and 92, the aircraft will 
trigger a change, for steering cue purposes only, in 56 
the identity of the current waypoint from point 92 to 
point 93 once it is within radius 91 . At that time it is 
now off of the preplanned flight plan along a path 



95. The algorithm will cause the steering cue 84 to 
smoothly steer the pilot back onto the path 95 
along a path 95a shown with a heavy line. Two 
other examples show starting positions 96, .97 re- 
sulting in flights along paths 98. 99, respectively, 
onto the new flight path 95. ft will be noted In all 
cases that the crossover of the circle 91 causes a 
change in course due to the change In identity of 
the next waypoint. 

Aside from cornering, the purpose of the steer- 
ing cue symbol is to direct the pilot back to the 
straight line path ("leg") between two successive 
waypoints (the previous waypoint and the current 
waypoint) when he has deviated therefrom. This 
will always place the pilot back on the prescribed 
leg of his mission in a smooth manner. 

Rg. 4B is a stylized illustration of a pilot's line 
of sight 85 to the horizon symbol 72 of Rg. 4A. It 
also illustrates the pilot's line of sight 85a to the 
base 78 of symbolic waypoint image 70, 74, 76. A 
rise in an undulating earth 85c is shown in section 
with the waypoint base 78 coincident with a point 
thereon, which may be a waypoint such as point 
108 in an earth coordinate system illustrated in Rg. 
8 of copending application (Attorney Docket No.: S- 
4170). Similarly, Rg. 4C stylistically illustrates the 
same scene from the pilot's point-of-view, as pre- 
sented by the display with the horizon symbol 72 
and waypoint symbol 70, 74, 78 shown. 



HEADING SYMBOLOGY 



Rg. 5 shows a display combining both aircraft 
heading/track angles (sensor 12 of Rg. 1) and off- 
aircraft axis targeting/sighting information such as 
helmet pointing angle (sensor 18 of Rg. 1). 

The heading tape symbol 90 consists of a full 
360 degree circle in a horizontal plane such that as 
the pilot turns his head he sees the portion of the 
heading tape that corresponds to his line of sight 
In the example of Rg. 5, the display shows 160 
degrees (16) to 190 degrees (19). The symbol tape 
90 may be set up so as to remain fixed in terms of 
its screen location so that it always remains parallel 
to the upper edge of the displayed area. As shown 
in Rg. 7, for example, the pilot has his head turned 
to his right tilted upwardly such that the tape sym- 
bology within his field of view (shown with solid 
symbols) appears in the upper portion of his field 
of view no matter which way he turns his head. 
Thus, the tape symbology "sticks" with the pilot's 
head. This is suggested by a nondisplayed portion 
of a circular tape shown in nonsolid symbols (in 
front) and phantom symbols (to the rear) encircling 
the pilot's head and which more clearly suggests 
the tilted orientation of the tape symbology with 
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respect to the horizon symbology. It has a one-to- 
one correlation with the real-world direction In that 
a change In either aircraft or helmet heading cor- 
responds to an equivalent change In the displayed 
portion of the heading tape. It should be realized, 
however, that the tape symbology could be pre- 
sented In-line or parallel with the horizon at all 
times. 

The display consists of tick marks 92 every 10 
degrees with numerical indicators 94 replacing the 
tick marks at every heading divisible by 10. These 
numerical Indicators are 2-dlglt numbers showing 
the left-most digits (heading 030 is displayed as 
03). The Cardinal headings may be replaced by 
their representative tetter 96 (N. S, E and W) as 
shown in Fig. 5, or may be shown in the same way 
as all other directions (see Fig. 7). The heading 
tape symbol 90 is augmented by a digital display 
98 showing the current aircraft heading. In this 
example, the pilot is looking almost due south (175 
degrees), and the aircraft is flying aimost due west 
(265 degrees). 

The entire moving scale rotates horizontally in 
an opposite direction but at an equivalent rate as 
any change in aircraft or pilot-helmet heading. The 
portion of the scale not being displayed is heid in 
memory until the pilot moves his head as sug- 
gested by the nonsolid and phantom symbols 
shown out of the pilot's field of view in Fig. 7. 

The aircraft symbol 84c indicates the aircraft's 
current heading with respect to the heading tape 
and may be used in conjunction with the steering 
cue 84b, e.g., to get back on a leg of a flight plan. 

This display allows the pilot to acquire earth- 
plane angular information more quickly and with 
less cognitive processing than is currently required. 



HELMET POINTING ANGLE SYMBOLOGY 



Fig. 6 shows a helmet pointing angle display 
symbolic image which may be used as a helmet 
pointing angle reference to the pilot, for example, 
while using night vision goggles or any 
targeting/sighting system that is directed by a hel- 
met tracking system such as a forward-looking 
infrared (FUR) imaging system. This type of dis- 
play differs from the Heading Display, in that it 
provides the pilot with a cue as to where he is 
facing within the cockpit itself rather than outside of 
the cockpit, but the two types of display techniques 
work well together. The Helmet Pointing Angle Dis- 
play provides the pilot with a nearly reflexive cue 
as to where he is looking within the cockpit during 
nighttime operations without the need for cognition 
on his part. 

The display provides, e.g., a pictorial display 



110 depicting a cockpit structure (window frames 
and instrument consoles) as it would be seen from 
the pilot's eye-reference point These are depicted 
as the heavy lines 112. Only that portion of the 

6 display representing the cockpit structure which is 
within the pilot's field-of-view is presented. 

The display reference symbology will always 
overlay Its real-world cockpit structure counterpart 
This display will allow the pilot to acquire, 

10 under night or low visibility conditions, 
targeting/sighting information more quickly and with 
less cognitive processing than is currently required. 
This display concept will allow the pilot to readily 
perceive the current line of sight (helmet pointing 

15 angle) because of the Increase in information trans- 
fer and relevance. 

This display technique may also be used for 
other symbolic images which may also be pre- 
sented in fixed relation to the cockpit or aircraft, 

20 regardless of the position and attitude of the helmet 
with respect to the cockpit, but which, for example, 
may not necessarily have any direct relation to 
physical objects or structures in the cockpit 

25 

OVERALL DISPLAY 



Fig. 7 shows the altitude display of Fig. 2, the 
30 power display of Fig.. 3, the waypoint and steering 
cue displays of Fig. 4, and the heading display of 
Fig. 5, as they would (aggregately) appear to a 
pilot on the eyepiece of a helmet mounted display 
system. Not shown is the helmet pointing angle 
35 display of Fig. 6 or the velocity/acceleration symbol 
of Fig. 12. 

It should be understood that other symbols 
could be substituted for the various symbols de- 
scribed without detracting from the cognitive effi- 
40 ciency of the display symbology herein. In addition, 
other symbolic imagery can be provided as well. 



VELOCITY/ACCELERATION SYMBOL 

45 

Most aircraft do not provide a cue for horizontal 
velocity information to a pilot when operating at low 
speed and the pilot must interpret the visual scene 

so to estimate the direction, magnitude, and rate of 
change of magnitude (acceleration or deceleration) 
of the vehicle's velocity. One helmet-mounted dis- 
play and several panel mounted display techniques 
incorporate a velocity vector (denoted generally by 

55 a numeral 114) such as is illustrated in Fig. 10 
which emanates from the center of the display at a 
point 115. It includes an acceleration dot (denoted 
generally by a numeral 116) which is used to 
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Indicate the direction and magnitude of horizontal 
acceleration by its position relative to the center of 
the display. An arrowhead (denoted generally by a 
numeral 117) is attached to the end of the velocity 
vector 114. Thus, for Fig. 10(A). a positive accel- 
eration is indicated by a point 116a in the direction 
of a velocity vector 114a. For Rg. 10(B), the accel- 
eration is zero and a velocity vector 11 4b is in- 
dicating a constant velocity. In that case, a dot 
116b coincides with an arrowhead 117b which is 
used at the end of the velocity vector. 

With this information, according to the prior art, 
the pilot determines the control inputs required to 
achieve the desired velocity state. A stationary 
hover task requires the pilot to cancel any velocity, 
and the precision of the hover point is determined 
by the pilot's ability to recognize and correct ve- 
locity changes quickly and accurately. 

The pilot's ability to interpret visual data from 
outside the cockpit is dependent on many factors 
including external cockpit visibility, surface con- 
ditions, level of ambient brightness (day, night 
dusk) and existence of obscurants are some exam- 
ples. Rotorwash during landing and hover in re- 
mote areas often causes heavy obscurants (dust, 
snow) to visibility. Some missions may call for 
flight in poor visibility conditions. When the visual 
scene cannot be interpreted, the pilot must rely on 
artificial cues or lose control of the aircraft The 
prior art symbology is helpful but not completely 
informative because of the lack of quantitative in- 
formation and the absence of a correlation between 
the velocity vector and the acceleration cue. 

Referring now to Figs. 11A-11C. the length of a 
velocity vector (denoted generally by a numeral 
120 with various suffixes) changes proportionally to 
the magnitude of the velocity of the aircraft The 
direction of the vector relative to the vertical axis of 
the display indicates the direction of the vehicle 
velocity relative to its longitudinal axis. The accel- 
eration or deceleration of the aircraft, i.e., the rate 
of change of the velocity vector may be perceived 
in a gross fashion by observing changes in the 
magnitude of the velocity vector. However, this 
requires the pilot to view the symbol for a relatively 
long period of time. Therefore, for instant cognition, 
velocity rate of change may also be indicated by a 
acceleration arrowhead with special features, ac- 
cording to the present invention. When the velocity 
is increasing, as shown in Fig. 11A(A) an arrow- 
head 122 points away from a point 115a. Diminish- 
ing velocity is indicated in Figs. 11A(C) by an 
arrowhead 126 pointing toward point 115a. A con- 
stant velocity is indicated in Fig. 11A(B) by a flat 
acceleration cue making a velocity vector arrow- 
head 124 appear as a "T n . 

The magnitudes of the velocity vectors 120a. 
120b. 120c of Figs. 11A(A). (B) and (C) all have 



about the same magnitude, being greater than a 
selected magnitude, such as 10 knots. 

Referring now to Rg. 11B. again, three different 
velocity rates of chanpe are shown in Rgs. 11B- 

6 (A'), 11(B') and 11(C). All three cases have ap- 
proximately the same magnitude velocity vectors 
120a' which Is less than the selected value of 10 
knots. Upon reaching a velocity less than the se- 
lected velocity of 10 knots, a symbol 130 having 

10 dashed lines appears surrounding the point 115. 
Although illustrated as a box, the symbol may also 
be a circle, or some other convenient shape and 
indicates, approximately, a velocity of, for example, 
5 knots. Thus, if the magnitude of the velocity 

is vector 120a' is reduced in size so as to coincide 
with the edges of the box 130a then the pilot will 
know that the aircraft is traveling at about 5 knots. 
Velocity vectors slightly longer or shorter than the 
boundaries of the symbol 130 can be easily men- 

20 tally estimated by the pilot in magnitude in analog 
fashion. 

It will be observed that the velocity symbols 
120a'. 120b', and 120c' of Rgs. 11B(a'), (B'), and 
(C'). respectively, are all tilted to the left indicating 

25 to the pilot that the horizontal component of the 
aircraft's velocity is off to the left of the longitudinal 
axis of the aircraft 

Rgs. 11C(A"), 11C(B*), and 11C(C") are similar 
to Rgs. 11B(A), 11B(B') f and 11B(C) in that the 

30 velocity vectors are pointing in the same direction 
for the same three types of rates of change (i.e., 
acceleration, constant velocity and deceleration, re- 
spectively). However, the magnitude of velocity 
vectors 120a*. 120b*. 120c" has become, relatively 

35 speaking, very small. In fact they are lesser in 
magnitude than another selected value, e.g., 5 
knots, at which point the dashed lines 130 become 
solid lines 132a, 132b. 132c. This technique may 
be used thusly to indicate that a hover hold system 

40 has become active at less than. e.g., the selected 
value of 5 knots. 

Rg. 12 illustrates how the arrowhead 122 may 
be altered for different magnitudes of acceleration 
in a more-or-less continuous manner. For example, 

45 Rg. 12(1) shows the arrowhead 122a at an accel- 
eration value ai which is greater than an accelera- 
tion value a2 shown in Rg. 12(2). It will be noted 
that the arrowhead 122a assumes an extreme ac- 
ute angle while the arrowhead 122b of Rg. 12(2) 

so forms almost a right angle. Similarly, for Rg. 12(3) 
the arrowhead 122c forms an obtuse angle where 
acceleration value az is greater than acceleration 
value a3. Thus, as the rate of change of velocity 
increases, the angle of the acceleration cue "ears" 

55 or "wings" get more acute. The same principle 
may be used for decelerations with the degree of 
acuteness also indicating high absolute values of 
rate of change and with the degree of obtuseness 
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indicating low absolute values of rate of change In 
velocity. 

Since the cue Is generated by sensor data and 
may always be presented on the display, It never 
degrades in operational conditions and Interpreta- 
tion of speed and acceleration are much improved 
over previous systems. Of course, the values ap- 
plied to trigger the scale boxes could be changed 
according to mission requirements. For example, a 
mine sweeping tow mission that requires constant 
velocity could have a two rectangular boxes inside 
one another indicating velocity tolerances. 

Although the invention has been shown and 
described with respect to a best mode embodiment 
thereof, it should be understood by those skilled in 
the art that the foregoing and various other 
changes, omissions, and additions in the form and 
detail thereof maybe made therein without depart- 
ing from the spirit and scope of the invention. 



nal, said plurality of cockpit signals into a cor- 
responding plurality of helmet signals indicative of 
said points in a helmet coordinate system; 
providing, in response to said helmet signals, a 
s corresponding plurality of display signals indicative 
of said points in a helmet display coordinate sys- 
tem; 
and 

providing, in response to said display signals, one 
w or more symbolic images of one or more cor- 
responding points in the cockpit which are within 
the pilot's field of view, said symbolic images being 
provided so as to coincide, from the point of view 
of the pilot, to the actual positions in the cockpit of 
75 said points, regardless of the helmet's attitude with 
respect to the aircraft 



20 



Claims 



1. A helmet mounted display system for dis- 
playing images to a pilot in an aircraft cockpit, 25 
comprising: 

sensor means, responsive to the attitude of the 
helmet with respect to a cockpit coordinate system, 
for providing a helmet attitude signal indicative 
thereof; so 
signal processing means, responsive to said hel- 
met attitude signal for retrieving stored signals indi- 
cative of points within the cockpit coordinate sys- 
tem which are within the field of view of the pilot as 
indicated by said helmet attitude signal, said signal 35 
processing means also responsive to said helmet 
attitude signal, for converting said retrieved signals 
from said cockpit coordinate system to a helmet 
coordinate system and from said helmet coordinate 
system to a display coordinate system and for 40 
providing converted retrieved signals for display; 
and 

means for providing to the pilot in response to said 
converted retrieved signals, symbolic images of 
said cockpit points such that said symbolic images 45 
coincide, from said piiofs point of view, with said 
cockpit points. 

2. A helmet related display method for provid- 
ing symbolic images to a pilot in a cockpit, com- 
prising the steps of: so 
sensing the attitude of the helmet with respect to a 
cockpit coordinate system and providing a helmet 
attitude signal indicative thereof; 

retrieving, In response to said helmet attitude sig- 
nal, a plurality of stored cockpit signals indicative ss 
of points within a cockpit coordinate system which 
are within the field of view of the pilot; 
converting, in response to said helmet attitude sig- 
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